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APPARATUS AND METHOD FOR COMMUNICATING 
OVER A DISTRIBUTED SYSTEM OF COMPUTERS 



Background of the Invention: 

This invention relates generally to apparatus used to communicate and more particularly 
to communication through a network of computers. 

The present discussion is in relationship to the Internet or the World Wide Web. This is 
done for simplicity of description and not to limit the scope of the invention. The invention is 
intended to cover any distributed network of computers as those of ordinary skill in the art 
readily appreciate. 

With the introduction and subsequent wide spread acceptance and use of the Internet, a 
medium for communication now exists in which millions of users have instant access to a wide 
range of information. While some of this information is static (i.e. news articles and product 
explanations), there are also a level of information that falls into the "motion" category (i.e. 

movies and live-cams). 

The motion category of information is usually communicated for its entertainment, as 
opposed to educational, purpose; but even this distinction is blurred by the broadcaster's 
ingenious use of the medium. 

To assist in communicating this content, a variety of patents have been developed to 
create a moving picture communicated through the Internet (sometimes referred to as "streaming 

1 

mi nit in MMP*iwmii|in 1 



video"). These include: United States Patent number 6,029,200, entitled "Automatic Protocol 
Rollover in Streaming MultiMedia Data Delivery System" issued to Beckerman et al. on 
February 22, 2000; United States Patent number 5,983,005, entitled "Multicasting Method and 
Apparatus" issued to Monteiro et al. on November 9, 1999; United States Patent number 
5,778,187, entitled "Multicasting Method and Apparatus" issued to Monteriro et al. on July 7, 
1998; United States Patent number 6,088,737, entitled "Information Processing System and 
Control Method Thereof issued to Yano et al. on July 11, 2000; United States Patent number 
6,079,566, entitled "System and Method for Processing Object-Based Audiovisual Information" 
issued to Eleftheriadis et al. on June 27, 2000; United States Patent number 6,072,483, entitled 
"Active Frame Scroll Interface" issued to Rosin et al. on June 6, 2000; United States Patent 
number 6,044,397, entitled "System and Method for Generation and Interfacing of Bitstreams 
Representing MPEG-Coded Audiovisual Objects" issued to Eleftheriadis et al. on March 28, 
2000; United States Patent number 6,009,410, entitled "Method and System for Presenting 
Customized Advertising to a User on the World Wide Web" issued to LeMole et al. on 
December 28, 1999; and United States Patent number 6,006,241, entitled "Production of a Video 
Stream with Synchronized Annotations over a Computer Network" issued to Purnaveja et al. on 
December 21, 1999; all of which are incorporated hereinto by reference. "Streaming Video" has 
become a popular mechanism for distribution of entertainment. 

It is clear from the foregoing that there is a significant need for enhanced video 
distribution over the Internet and other distributed networks of computers. 
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Summary of the Invention: 

The invention is a communications system particularly suited for a distributed network of 
computers such as the World Wide Web or the Internet. While the nomenclature or title 
changes, a distributed network of computers is a grouping of computers which share information 
(whether the information is stored within a computer or is generated by operators of the 
computers). This sharing of information is accomplished through a variety of mechanisms well 
known to those of ordinary skill in the art and can be either "hard wired", "wireless", a 
combination thereof, or other techniques. 

Connected to the distributed network is a broadcast computer. Within this context, a 
"computer" is an electronic apparatus which executes a series of commands. In one embodiment 
of the invention, a "gang" or grouping of computers is utilized to serve the function of the 
"broadcast computer". A grouping of computers is intended to be included within this 
definition. 

The broadcast computer simultaneously communicates two streams of video. Suitable 
techniques for this task are explained in detail in the patents referenced above. Those of ordinary 
skill in the art readily recognize a variety of other methodologies which will serve this function. 

The first stream of video contains entertainment. This video stream is created through a 
variety of techniques. In one embodiment of the invention, a pre-recorded video is stored within 
the library or memory of the broadcast computer and is then "downloaded" upon request. 

In yet another embodiment of the invention, the video stream is "live". In this 
embodiment, a camera or cameras is established to capture a scene as it happens. The electronic 
stream from the camera is communicated to the broadcast computer "live" to give the viewer an 

3 

'upiifiimmiiiiini 1 1 



immersion into the activity. This embodiment of the invention is particularly suited for use 
within a theme park. This embodiment allows the viewer to view the activities at a remote theme 
park and enjoy the activities and costumed characters. 

The second stream of video contains commercial content. While the distinction between 
"commercial" and "entertainment" is often blurred, this second stream of video's predominate 
purpose is to acquaint the viewer with produces) or service(s) with the intent that, once so 
informed, the viewer is enticed to purchase the product(s) or service(s). 

As example, using the live theme park for reference, the first video stream might contain 
live action from the main street within the theme park while the second video might contain 
video information on the local hotels. 

At the other end of the network of computers is a computer which serves as the receiver. 
The receiving computer simultaneously displays the two streams of video. The user of the 
receiving computer is able to view both action scenes simultaneously and is able to select which 
stream's audio component is played using the receiving computer's loudspeakers. 

Using the prior example of the theme park, the view is able to see both the video on the 
main street and also the video commercial on the hotels. For a while the viewer "listens" to the 
main street (say as the band passes by) and later changes to hear the video on the hotel being 
described. In this way, the viewer is given an idea of the theme park's entertainment, and is also 
able to consider lodging options near the theme park. 

In one embodiment of the invention, a display is produced to track the commercial 
video's content. This display is usually a scrolling apparatus allowing the user to "backtrack" to a 
specific spot on the video. As example, if the video has progressed past the Hilton Hotel and the 



Days Rest and is now displaying the commercial description of the Slumber Inn, the user is able 
to "click" (select) Days Rest and have the commercial video retrace itself to this location for a 
second display for the viewers review. 

In a further embodiment of the invention, the "click" on Days Rest initiates a link (via the 
distributed network of computers) with the reservations computer for Days Rest; thereby 
allowing the user to make reservations while still on-line. 

In this embodiment of the invention, the linking of the receiving computer with the Days 
Rest computer may sever the link with the broadcast computer; or the Days Rest computer 
communicates messages which simply replace the area of the receiving computer's screen that 
was displaying the second video. 

In one embodiment of the invention, the user is also able to replace the commercial 
channel with another commercial channel. This capability provides the user with a fresh 
advertisement video; thereby allowing the user to purview other products or services. 

Using the prior example of the theme park, the second video stream on hotels in the area 
may be replaced with a video giving details on flight schedules, car rentals, novelty products 
from the theme park, etc. 

The invention, together with various embodiments thereof, will be more fully explained 
by the accompanying drawings and the following description thereof. 
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Drawings in Brief: 

Figure 1 is a functional layout of the preferred embodiment of the invention. 
Figure 2 is a functional layout of the preferred broadcast computer. 
Figure 3 is a functional layout of an alternative embodiment of the broadcast computer. 
Figures 4A, 4B, and 4C are views of user/receiver displays for the preferred embodiment 
of the invention. 

Figures 5 A and 5B are views of the user/receiver displays showing alternative 
embodiments for communicating a merchant's site to the user/receiver. 

Figure 6 illustrates the informational context communicated from the broadcast computer 
to the network of computers. 

Figure 7 is a flow-chart of the operation of the broadcast computer in the preferred 
embodiment. 

Figure 8 is a flow-chart of the operation of the receiving computer in the preferred 
embodiment. 



Drawings in Detail: 

Figure 1 is a junctional layout of the preferred embodiment of the invention. 

Within this illustration, the distributed network of computers is illustrated as the Internet 

12. Using this network is the broadcast computer 10, the receiving computer 13, and the 
merchant computer 1 1 , as well as many others not shown. 

Information is exchanged between the broadcast computer 10 and the receiving computer 
13 using channels 16A and 16B. Channel 16A permits the two video streams, their associated 
audio, and other data streams to be communicated through Internet 12 to exit as channel 16B and 
used by the receiving computer 13. This information, is communicated to a user using display 13 
and speakers 13B. 

In like fashion, information generated by the user of receiving computer 13 is 
communicated via channel 16B through the Internet 12 and channel 16A to the broadcast 
computer 10. This return exchange of information permits the user to request certain information 
from the broadcast computer, such as, but not limited to, changing the commercial video being 
sent by broadcast computer 10. 

In this illustration, the entertainment video stream is originally generated by camera 14 
which captures a live action 15. The output of camera 14 is communicated to the broadcast 
computer 10 which sends out the video stream substantially upon receipt, to receiving computer 

13. This embodiment is particularly useful for the scenario described above where the live action 
1 5 is collected from a theme park. 

The user of receiving computer 13 is able to "link" with merchant computer 1 1 and obtain 
information concerning the products provided by the merchant and which have been advertised 
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using the commercial channel originating from the broadcast computer. 

The information from the merchant computer 1 1 is communicated to the Internet 12 via 
channel 16C and is obtained by the receiving computer using channel 16B. 

In this discussion, channels 16 A, 16B, and 16C, may or may not be physical links such as 
telephone lines, or the like. These channels are used to show the passage of information from the 
Internet 12 to and from the various computers connected to the Internet 12. 

Note, in this illustration, although the commercial content of the video is being 
disseminated by broadcast computer 10, the user is able to directly contact the merchant's 
computer 1 1 (which is remote from broadcast computer 10) to obtain further information on the 
products, clarify points of interest on the products advertised, or to place orders for specific 
goods from the merchant. 

Figure 2 is a functional layout of the preferred broadcast computer. 

In this preferred embodiment of broadcast computer 10, the incoming video 20 is 
communicated through gate 21A. The entire operation of broadcast computer 10 is controlled by 
Central Processing Unit (CPU) 21D. CPU 21D, through control of gate 21 A allows the video 
stream to flow to output mechanism 21B and then into channel 16A which places the video into 
the Internet (not shown in this illustration). 

CPU 21 D also draws information from memory 21 E which is combined with the video 
through gate 21 A. This information is usually textual in context In the preferred embodiment, 
the textual information withdrawn from memory 21E is a schedule of what events are 
forthcoming within the video stream 20. As example, the textual information for the theme park 
example may read: 
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Event 



Time to Event 



Main Street Parade 



15 minutes 



Interview with Guest 



25 minutes 



Band Time News 



32 minutes 



This textual information is updated as time progresses. 

Memory 2 IE, in this embodiment, is used to store the commercial videos. As directed by 
CPU 21D, memory 21E communicates a commercial video via output 21C to join in channel 
1 6A with the entertainment video. 

Selection of the proper commercial video within memory 21E is accomplished either 
automatically, or in response to a remote user's input received via channel 16A and 
communicated to input 21F for use by CPU 2 ID. 

Further control of CPU 2 ID is accomplished by operator station 22 which uses montiro 
23 and keyboard 24 for two-way information exchange with CPU 21D. 

Figure 3 is a functional layout of an alternative embodiment of the broadcast computer. 

Broadcast computer 10A is centrally controlled using control 30A. Stored with control 
30A are directions (either using software or hardwired) to withdraw from memory 30B, both the 
entertainment video as well as the commercial video. In this embodiment, the entertainment 
video is typically pre-recorded and then is communicated when the user requests it. An example 
of such a pre-recorded video is a movie or documentary. 

The entertainment video is communicated from memory 30B to the entertainment 
computer 30C which formats the video stream and communicates it to the remote receiver using 
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a first source address 31 A (denoted in this illustration as "address/E". In like fashion, the 
commercial video is communicated from memory 30B to the commercial computer 30D which 
then formats the commercial video and communicates it using a second source address 3 IB 

(denoted "address/C"). 

This embodiment of the invention is particularly powerful as it permits the receiver to 
view two different sites (video sites in this illustration) at the same time. 

To use the prior example of a theme park, in one embodiment of the invention, when the 
core address for the theme park is: http://www.themepark.com, then the address for the 
entertainment video and commercial video would be: 

entertainment video- http://www.themepaik.oom/entertainment 
commercial video- http://www.themepark.com/commercial/hotels 
Other commercial videos would use other address for communicating their particular 

genre of commercials: 

http:www.themepark.com/commercial/rentalcars (for rental cars) 

http:www.memepark.com/commercial/eating (for restaurants) 

http:www.themepark.com/commercial/curios (for items from the park) 

It is clear that using this technique, any number of commercial videos can be stored and 
then retrieved to be sent out as per the request of the receiving computer. 

Figures 4 A, 4B, and 4C are views of user/receiver displays for the preferred embodiment 
of the invention. 

Referring to figure 4A, the two video streams are displayed as entertainment 40A and 
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commercial 42 A. The audio component of the video for the entertainment 40 A is chosen by 
audio bar 41 A allowing the entertainment audio to be communicated to speaker 47A. When 
audio bar 41 A is activated, audio bar 48A is muted, thereby allowing only a single audio 
component to be played at any one time. 

Commercial video 42A continues to play, associated with commercial video 42 A is an 
historical linking 43 A which provides the means for the user to "backtrack" to past 
advertisements or to select other commercial subject matters. This allows the user to "notice" an 
advertisement and not have to rush to "click" and gain further information before the 
advertisement disappears from the commercial video 42A. 

Pre-view chart 44A is tied to entertainment video 40A and provides a listing of what 
events are forthcoming on entertainment video 40A. This allows the user to anticipate the 
upcoming events. 

For this embodiment of the invention, the "browser" or software used by the receiving 
computer is designed to capture video from two different addresses, 45 A and 46A. These 
addresses define the source of the entertainment video 40 A (address 45 A) and the commercial 
video 42A (address 46A). 

Figure 4B illustrates the situation where the user has activated the audio component from 
the commercial video 42B using audio bar 48B. This automatically mutes audio bar 41B so that 
only the audio for the commercial video 42B is played by speakers 47B. 

Note, the receiving computer is still linked to the same addresses 45B and 46B as that 
shown in figure 4A. Switching these addresses, as shown in figure 4C results in a different 
commercial video 42C being shown. 
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While the entertainment address 45C remains the same, the user has connected to a new 
commercial address 46C. This accomplished, in the preferred embodiment, by clicking on 
linking 43C which results in a new commercial video 42C being shown. 

In the manner outlined in figures 4A, 4B, and 4C, the user of the receiving computer is 
able to select which commercial video is shown, and the audio used while both an entertainment 
and an audio video are simultaneously displayed. 

Figures 5 A and 5B are views of the user/receiver displays showing alternative 
embodiments for communicating a merchant's site to the user/receiver. 

Figure 5 A illustrates the preferred embodiment of the invention in which the receiver has 
chosen to be linked with the merchant computer. Displayed on the receiving monitor 50A is the 
entertainment video 51 corresponding to address 53, as well as the merchant's display 52 
corresponding to address 54A. 

Note, the source of entertainment video 51 is from the broadcast computer; the source of 
the merchant display 52 is from a different computer, often owned and operated by the merchant 

An alternative embodiment is shown in figure 5B. In this embodiment, when the receiver 
wants to view the merchant's display 52, it totally captures display 50B and the receiving 
computer is linked only with address 54B. 

Figure 6 illustrates the informational context communicated from the broadcast computer 
to the network of computers. 

Within the preferred embodiment, the informational content 60 being sent by the 
broadcast computer falls into six main categories: 

1- Textual material related to the entertainment portion 61 ; 
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2- Entertainment video stream 62; 

3- Audio associated with the entertainment video stream 63; 

4- Commercial video stream 64; 

5- Audio associated with the commercial video stream 65; and, 

6- Textual material relating to historical accounting of the commercials (often 
being links to merchants), as well as selections for alternative commercial videos. 

Those of ordinary skill in the art recognize a variety of other types of information that 
may be included with this grouping. 

Figure 7 is a flow-chart of the operation of the broadcast computer in the preferred 
embodiment 

Once start 70 A occurs, the program determines if the viewer is ready 71 A, When the 
viewer is ready, the program selects a commercial video 72A and then transmits the 
entertainment video and audio, simultaneously, the selected commercial video and audio is 
transmitted 72B 

A check is then made to determine if the user wants to change the commercial 7 IB, in 
which case the new commercial video is withdrawn 72C and then transmitted 72B. 

If the user does not want to change the commercial video 7 IB, then a determination is 
made on if the entertainment video has been completely run 71C. If so, the program stops 70B; 
otherwise, the next segment of the entertainment video and audio (together with the selected 
commercial video and audio) is sent 72B. 

Figure 8 is a flow-chart of the operation of the receiving computer in the preferred 
embodiment. 
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When the receiving computer starts 80A, it links with the broadcast computer 81 A, and 
obtains the downloaded data 82A. This downloaded data is the entertainment video and audio, 
the commercial video and audio, the schedule, and the links. 

If the user of the receiving computer doesn't want to change 83 A, the downloaded 
material is displayed 84D. A determination is made to continue 83B, and if the program is to 
continue, the link with the broadcast computer is refreshed 81B and a new set of download data 
82A is collected; if the program is not to continue, it stops 80B. 

Returning to the options available to the user of the computer 83A, the user's choices also 
include the ability to change the audio feed to the commercial video 84A (followed by the 
continue option 83B and its subsequent operations described above). 

Another option available to the user is to selected a different commercial video 82B, after 
which the data on the new commercial video and its associated audio is downloaded 82C; 
whereupon the videos are displayed using the audio from the new commercial video 84B. Again, 
the choices on continue 83B are then executed. 

Yet another option allows the user to link with the merchant computer 81C. The 
merchant site is then displayed 84C. Once the merchant site has been utilized by the user, the 
program stops 80C. 

It is clear mat the present invention provides for a highly improved communication 
mechanism and method suited ideally for a distributed network of computers. 
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